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S.N. 10/733,316 

VERSION WITH MARKINGS TO SHOW CHANGES MADE 

METHOD OF TRADING INFORMATION 

BACKGROUND OF THE INVENTION 

F ie ld of th e I nv e nt ion 

The present invention relates to a method fe^of trading image information^ 

such as still images, movie images or the like A via communications means,, such as 

the internet or the like T ; and A more particularly , the invention relates to a method fef 

of trading image information in which the reliability of the image information, such as 

the authenticity of the information, prevention of falsification of the information and 

the like, is improved, and tgjndustrial products to which this image information is 

appended. 

Or. D e scr i ption of tho R e lat e d A ft 

Conventionally, in the handling of images and image information in the field of 
information communications, and especially in connection with communication on 
the internet, various methods for preventing falsification have been proposed in order 
to prevent copyright violations and the like. For example, measures for preventing 
falsification^ such as encoding using the inverse function of a one-way function 
based on a decryption key on images input from a digital image recording apparatus 
and the like A are described in Japanese Patent Application Laid-Open No. H1 1- 
98461. 

Such electronic signature methods afe -constitute security systems for images 
that are transmitted and received via the internet or the like; however, such systems 
have no effect in cases where a falsification of information is made prior to the 
electronic signature processing that is performed before the data is stored in the PC 
used for anti-falsification processing from the digital image recording apparatus prior 
to transmission or reception. 

As an example of the application of image information, in cases where the 
welded portions of metal parts are to be inspected by a non-destructive inspection, 
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an inspection that is performed in order to discover fissures, cracks or the like 
occurring in the welded portions of such metals or the like is currently accomplished 
by means of a-visual inspection performed by an inspector. A nondestructive method 
in which an inspection for defects in the welded surfaces is performed using digital 
images or the like relating to the metal surfaces is also conceivable as a means of 



In cases where an inspection is performed by transmitting such image 
information via the internet, it is necessary to ensure the reliability and authenticity of 
the image information that is inspected, as-to determine whether or not this 
information comprises images that were obtained by properly imaging the object, 
and whether or not the images were falsified. 

Specifically, in order to perform various types of inspections using image 
information as-typified by digital still images, it is necessary to make it possible to 
confirm that the images have not been falsified from a time immediately following the 
imaging of the images by an imaging device^ such as a digital camera or the like. 



The present invention provides a method of trading image information which 
makes it impossible to falsify images once these images have been imaged, and 
which makes it possible to confirm that such images have not been falsified following 
imaging. 

Specifically, in accordance with t he present invention, the place and time at 
which images are obtained can be clearly specified by receiving a JJY standard 
frequency transmitted from Communications General Laboratories or a GPS (global 
positioning system) satellite wave, and adding accurate and precise information 
regarding time and place to the image information, so that reliable image information 
is obtained. Furthermore, the reliability of such image information can be further 
increased by adding imaging information regarding air temperature, humidity, 
altitude, environment, sound and the like. Moreover, the method of the present 
invention is devised so that data that allows identification of the camera used in 




carrying out such an inspection. 



SUMMARY OF THE INVENTION 
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imaging and the person performing this imaging can also be added to the image 
information. 

Furthermore, falsification can be prevented by a circulation system in which 
the image information is controlled and circulated by a specified organization or 
association, and various types of visual inspections or the like can be widely 
rat i ona li zed carried out in all types of fields as a result of the acquisition of reliability 
by such image information. 

These and other objects, features and advantages of the invention will be 
apparent from the following more particular description of preferred embodiments of 
the invention, as illustrated in the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram which shows one embodiment in which the image 
information of the present invention is applied to a piping installation; 

Fig. 2 is a diagram which shows one embodiment in which the image 
information of the present invention is applied to a construction project; 

Fig. 3 is a diagram which shows one embodiment in which the image 
information of the present invention is applied to food processing; 

Fig. 4 is a diagram which shows one embodiment of image acquisition means 
which make it possible to create the image information of the present invention; 

Fig. 5 is a block diagram which shows one embodiment of image acquisition 
means which mak e i t poss i ble operates t o create the image information of the 
present invention; 

Fig. 6 is a diagram which shows one embodiment of the construction of a 
system for trading the image information of the present invention; 

Fig. 7 is a flow chart which shows one example of the flow of information in a 
system for trading the image information of the present invention; 

Fig. 8 is a flow chart which shows another example of the flow of information 
in a system for trading the image information of the present invention; 



4 



Fig. 9 is a flow chart which shows another example of the flow of information 
in a system for trading the image information of the present invention; 

Fig. 10 is a diagram which shows one embodiment of the information search 
system of the present invention; 

Fig. 1 1 is a diagram which shows one embodiment in which the image 
information of the present invention is applied to the prevention of falsification of 
images; 

Fig. 12 is a block diagram which shows one embodiment of image acquisition 
means which mak e it poss i bl e operates to create the image information of the 
present invention; and 

Fig. 13 is a diagram which shows one embodiment of an inspection warning 
to which image information of the present invention has been appended. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Embodiments of the present invention will be described below with reference 
to the attached figures. 

Fig. 1 shows an example in which information regarding the conditions of a 
welding inspection of metal piping 109 A which is used in a large installation^ such as 
a generating plant or the like, and which is imaged by means of a digital camera, is 
expressed as image information ef- in accordance with the present invention. In this 
metal piping 109, three pipes are connected by welding; and, the reference numeral 
110 indicates the welding marks at the joints between these p i p es. In order to 
inspect for welding defects in the welding marks 1 10, a penetrating damage-locating 
test treatment is performed, and defective areas A such as fissures, cracks or the like A 
can be observed by means of a red pattern. 

Furthermore, it would also be possible to perform a magnetic powder 
damage-locating treatment^ instead of a penetrating damage-locating treatment. In 
this case, the regions including the welding marks 110 are illuminated with ultraviolet 
light, and the fluorescence generated by defective areas A such as fissures, cracks or 
the like. Is ^can be detected. 
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In regard to the installation image information 101, along with an image of the 
metal piping 109, imaging time information 102, position information 105 indicating 
the imaging location in terms of latitude and longitude, imaging environment 
information acquired at the time of imaging,, such as air temperature information 103, 
humidity information 104, illumination information 106, air pressure information 107 
and altitude information 108, an identification code (not shown in the figures) for the 
digital camera which is used, the name and identification code (not shown in the 
figures) of the person performing the imaging and the like A are displayed in an 
environmental information region 111 within the same image. 

The displayed time information 102 disp l ays a va l u e constitutes information 
obtained by receiving a JJY standard frequency. Furthermore, in the case of the 
location information 105, highly precise information from a GPS satellite wave is 
acquired, calculated and recorded. In the still images of the digital camera ef 
according to t his example, environmental information is added at the time of imaging; 
however, in the case of moving images, how e v e r, environmental information during 
image recording is continuously written. 

The time information and position information is highly reliable information as 
a result of the use of accurate and precise information wh i ch that is public 
information. Fe Hn the exampler-in- of Fig. 1, the location of the plant in which the 
metal piping 109 was present, and the location of the installation within the plant, can 
be specified from the position information 105 obtained from a GPS satellite wave. 
Furthermore, the manufacturing m e thod process step t hrough which the metal piping 
109 was passing at the time of imaging can be ascertained from the time information 
102. As a result, the origin of the installation image information 101 is clear in terms 
of which piping was in which state, so that this information is endowed with reliability. 
As a result of the information relating to place and time thus being strictly specified, 
the images constitute information in an extremely limited narrow space, and A 
therefore , the images have a genuineness that allows no room for the entry of other 
falsifying factors, so that the images have a high added value. 
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To describe this feature in more detail when the time information 102 of the 
installation image information 101 of the present embodiment is compared with a 
manufacturing process table (not shown in the figures) or the like which specifies the 
processing of the metal piping 109, it can be confirmed that the current state is a 
welding inspection state. Furthermore, from the position information 105 and a layout 
diagram (not shown in the figures) of the interior of the plant or the like, it can also be 
confirmed which part of which installation contained the piping parts, and it can be 
verified from the time and position information that the installation image information 
101 does not comprise spurious images. 

By using the highly reliable image information of the present invention, it is 
possible to perform an inspection for defects in the welding marks 110 indirectly 
using the installation image information 101. In conventional inspections for defects 
in welding marks, an inspector possessing the necessary qualifications for 
performing such inspections repeatedly visits the site of the piping and makes a 
visual inspection; however, if image information is used, instantaneous transfer is 
possible, so that inspection and confirmation can be accomplished without the 
inspector being on-site. Even in a remote location, an inspector can perform an 
inspection for defects by looking at the welding marks 1 10 in installation image 
information 101 that is displayed on a screen or has been printed out. 

Furthermore, a quantitative evaluation of a defect inspection can be 
performed instead of a visual inspection by performing a defect inspection using 
image processing from images displayed in the image region 112. In this case, in 
order to perform image processing with a correct evaluation of the resolution of the 
images that are imaged by the digital camera, the installation image information 101 
must include an image obtained by imaging a resolution evaluation sample with the 
digital camera A along with an image of the welding marks 110. 

Furthermore, for example, in cases where defects or problems are discovered 
following the completion of the installation of the metal piping 109, the cause of such 
problems can be inferred from the information regarding air temperature 103, 
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humidity 104, air pressure 107 and altitude 108 within the installation image 
information 101, so that the installation image information 101 also has a high utility 
value in terms of maintenance. 

Furthermore, in cases where changes in the metal piping 109 over time are 
monitored using the installation image information 101, new installation image 
information 101 at the current point in time can be obtained under the same 
conditions as at the time of previous imaging by calling up previously imaged and 
stored installation image information 101, and using the information regarding the 
data and time of previous imaging and environmental conditions at the time of 
previous imaging that ts -have been recorded in this previous installation image 
information 101. As a result, a plurality of sets of installation image information 101 
that have been imaged over time can be compared in a simple manner, so that the 
changes in the metal piping 109 over time can easily be evaluated. 

In regard to methods used to call up previously imaged and stored installation 
image information 101, a personal computer connected to the internet or a mobile 
telephone equipped with an internet function may be used. The installation image 
information 101 that is called up is displayed on the screen of the personal computer 
or mobile telephone. 

Fig. 2 shows an example in which the construction of the foundation of a 
building is e xpr e ss e d represented as image information ef nn accordance with the 
present invention , which information is obtained from construction processes imaged 
by a digital camera. In the construction image information 201, the conditions of the 
construction of the foundation part 206 of a-the_building that ifHS_under construction 
outdoors are displayed together with environmental information regarding the time 
202, air temperature 203, humidity 204, wind velocity 209, and latitude and longitude 
205. This environmental information indicates the following: first of all, the position 
205 indicates which building is involved, and the time 202 indicates the conditions of 
progress in the construction process. Accordingly, the images and the building can 
easily be compared. 
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Furthermore, using the time information 202, confirmation can be made from 
the number of steel re-bars 207 and the like in the foundation part 206 of this 
building as to whether or not construction standards^ such as the required number of 
re-bars and the like,, have been satisfied. Moreover, if the distribution of the 
hardening material 208 is recorded in the images at the same time, concerns about 
strength on the part of the builder can be assuaged, and doubts about illegal 
construction can also be eliminated, so that the reliability of the building construction 
can be backed up established . Furthermore, anxiety and distrust can be eliminated 
by disclosing such information to the builder, nearby populace and the like during 
construction. 

If damage or failure should occur for some reason following the completion of 
the construction shown in the construction image information 201, this information 
may constitute important data for investigating the effects of the environment on the 
building in an e lucidat i on investigation of causes and the like from the air 
temperature 203, humidity 204 and wind velocity 209. 

Fig. 3 shows an example in which the -process of manufacturing process of a 
food product that is imaged by a digital camera is expressed as image information ef 
in accordance with the present invention. In this food product image information 301 , 
the conditions of the manufacturing process in a food processing plant, in which a 
processed beverage 310 is sealed in glass containers 307 on a conveyor 308 A are 
displayed along with environmental information regarding the time 302, air 
temperature 303, humidity 304, intensity of ultraviolet radiation 312, degree of 
cleanness 305 and latitude and longitude 306. 

The environmental information indicates the following: first, the year, month 
and day of manufacture can be confirmed from the time 302, and the manufacturing 
plant can be confirmed from the plaee -location 306. As a result, in cases where 
some type of abnormality occurs in the shipped beverage product, the image 
information is effective in elucidating the causes of this abnormality. Furthermore, 
hygiene conditions^ such as the possibility of the generation of bacteria or the like A 
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can be ascertained from the air temperature 303, humidity 304, intensity of ultraviolet 
radiation 312 and degree of cleanness 305. In addition, the inspection conditions can 
be ascertained from the condit i ons of separating out of defective glass containers 
311. Furthermore, such information leads to improved reliability of the product by the 
disclosure of information under normal circumstances, and not just in the case of 
abnormalities. 

Fig. 4 shows an example in which image acquisition means that can be used 
to create the image information of the present invention ar e e xpr e ss e d as is provided 
in the form of a digital camera. The image acquisition means 401 conta i n consists of 
a digital camera , and ar e w hich is equipped with an antenna 402. A GPS satellite 
wave is received by the antenna 402, so that the position of the digital camera 401 
can be ascertained in terms of longitude and latitude. Furthermore, the accurate 
imaging time is obtained by receiving a JJY standard frequency. 

Moreover, the image acquisition means 401 conta i n contains numerous types 
of sensors 403, and the air temperature, humidity, illumination, air pressure, altitude, 
degree of cleanness and the like are measured by these sensors 403. Such 
information can also be acquired from signals received by the antenna 402 rather 
than from the sensors 403. The digital camera 401 incorporates such information 
into the images at the time of imaging; furthermore, this image information may be 
sent to a storage destination via the internet or the like from the antenna 402. 

Fig. 5 shows an example in which the construction of the image acquisition 
means 401 shown in Fig. 4 is expressed as a block diagram. 

The images are input by means of an imaging device 501. For example, this 
imaging device 501 is a digital camera, digital video camera, DVD camera or the like. 
Simultaneously with image input, a standard frequency JJY indicating the standard 
time is received by a standard time signal receiver 504, and the time value of this 
signal is converted into an image signal format by a character converter 503. 
Similarly, a GPS satellite wave is received by a satellite wave receiver 512, latitude 



10 



and longitude values are calculated from this wave signal by a calculator 513, and 
these values are converted into an image signal format by a character converter 514. 

Furthermore, signals are also input simultaneously with the image input are 
s i gna l s from a temperature sensor 505 and a humidity sensor 508. The sensor 
outputs are converted into digital numerical values by respective sensor amplifiers 
506 and 509, and these values are converted into an image signal format by 
character converters 507 and 510. Sensors may be added in accordance with the 
items that are to be measured. 

The output information signals 515 of the character converters 503, 507 and 
510 that convert the respective waves and sensor values into an image signal format 
are synthesized with the image signal 516 from the imaging device 501 by an image 
signal mixer 51 1, and all of this information is incorporated in the image, thus 
producing image information 517. 

The image information 517 is sent out from an image transmitter 502, and jtjs 
transferred via the internet. Alternatively, the image information 517 is stored in a 
read-only memory 518. In order to prevent falsification by the party performing the 
imaging, this memory 518 is constructed as a read-only memory which does not 
allow overwriting once writing has been performed. 

Fig. 6 is a model diagram e ^illustrating t he image information trading method 
of the present invention using a plant facility as an example. 

TJ=HS-A_piping plant 601 manufactures piping products 602 in accordance with 
orders from customers 607 (e. g., a generating plant). In the piping plant 601, 
inspection conditions for the completed piping product 602, or inspection conditions 
during manufacture, are imaged by a digital camera 603. The digital camera 603 can 
create image information ef- accordinq to the present invention, and piping image 
information 604 A in which environmental information regarding the time of imaging 
and the position, air temperature and the like during imaging is incorporated into the 
acquired images A const i tutes a is generated for the commercial product. 



11 



Information such as an image of a resolution evaluation sample acquired by 
the digital camera 603 for the purpose of correctly evaluation evaluating the 
resolution of the images, as well as camera identification data that specifies the 
digital camera 603 used for imaging, identification data that identifies the person 
performing the imaging and the like, is also added to this piping image information 
604. 

After this piping image information 604 has been subjected to anti-falsification 
processing^ such as the-electronic signature processing as disclosed in "PGP Code 
Mail and Electronic Signatures, Encryption for Everyone" by Simson Garfinkel 
(O'Reilly Japan Inc.), or the-image watermark processing disclosed in "Electronic 
Watermarks and Protection of Contents" by Tsukasa Ono (Ohm-sha), the information 
is electronically transmitted to an image information managing company 605, an4 
where it is stored. 

However, if an electronic watermark or the like is added to the image portion 
of the image information, there may be cases in which the original image is lost, so 
that accurate processing results cannot be obtained by image processing. As a 
countermeasure against this problem, there are methods in which the imaging 
means afe-js_not provided with an image recording medium for preserving the 
captured image. In cases where there is no image recording medium for preserving 
the captured image in the digital camera 603, image information cannot be 
accumulated. Instead, the piping image information 604 is sent to the image 
information managing company 605 via the internet or the like immediately after 
imaging, and jtjs stored by this company. Accordingly, images do not remain at hand 
in the piping plant 601, and falsification is made impossible by the control of the 
image information managing company 605, so that the images constitute image 
information with a high degree of authenticity and reliability, and image processing is 
also possible. 

An independent inspection organization 606 A which uses the image 
information 604 to perform an inspection for the presence or absence of surface 
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defects in the piping product 602 A acquires the image information 604 from the image 
information managing company 605 via the internet or the like in accordance with 
inspection requests from the piping plant 601 or customer 607, and jLperforms an 
inspection for surface defects using an image processing system 608. The results of 
the inspection processing are reported via the internet or the like to the piping plant 
601 or customer 607 where the request originated. 

In cases where defects are discovered in the inspection results, information 
regarding the defects is reported to the customer 607 via the internet together with 
an image of the sample surface that contains these defects. Since the customer 607 
can ascertain the quality of the product to be purchased according to the inspection 
results beforehand, the risk to which the customer 607 is exposed can be reduced; 
furthermore, in the case of the piping plant 601, since reliability can be ensured by 
selling the product with the inspection results appended to the product, the added 
value is increased. 

The flow of information in the abovementioned system will be described with 
reference to Fig. 7. 

First, a customer 607 places an order for the manufacture of a piping product 
from the piping plant 601. The piping plant 601 images the piping product for which 
an order has been received at an intermediate stage during manufacture; and A upon 
the-completion of manufacture , the product is imaged by means of a digital camera 
603, and transmits the image information 604 is transmitted t o the image information 
managing company 605 via the internet. 

The image information managing company 605 notifies the sender on the side 
of the piping plant 601 that the image data has been received, and charg e s then t he 
piping plant 601, via the internet, changes a fee corresponding to the amount of 
transmitted image information 604. 

The piping plant 601 pays the requested fee to a designated financial 
institution, and the image information 604 is registered and stored at the time that 
this payment is confirmed. Furthermore, the charging and payment of fees need not 
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be performed for each transmission of image information 604; such charging and 
payment may be performed periodically on a consolidated basis. 

Next, the piping plant 601 issues a request for inspection to the inspection 
organization 606 via the internet. After confirming that the piping plant 601 has been 
charged r .and that payment has been received from the piping plant 601, the 
inspection organization 606 that has received the request for inspection orders the 
registered image information 604 from the image information managing company 

605 via the internet. 

After charging a fee for the order received from the inspection organization 

606 and confirming that payment has been received, the image information 
managing company 605 transmits the image information 604 to the inspection 
organization 606 via the internet. 

The inspection organization 606 , upon receiving the image information 604 
from the image information managing company 605 A performs an inspection for 
surface defects using an image processing system 608, and transmits the inspection 
results via the int e rn e d internet to the piping plant 601 where the request originated. 

The piping plant 601 that receives the inspection results also sends data 
regarding the inspection results received from the inspection organization 606 to the 
customer 607 via the internet at the time that the completed piping product is 
delivered to the customer 607. When the piping plant 601 receives notification of a 
passing inspection grade from the customer 607, the piping plant 601 submits a 
request for payment of charges, and the charges are paid by the customer. 

The syst e m procedure shown in Fig. 7 is one example, and the method and 
timing of billing and payment performed among the piping plant 601, image 
information managing company 805, inspection organization 606 and customer are 
not limited to this example. For example, buffing and payment need not be 
performed at the time of each request or order; rather, such billing and payment may 
be handled periodically on a consolidated basis. 
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Furthermore, data regarding inspection results need not always be sent via 
the internet at the time that the completed product is delivered to the customer 607 
from the piping plant 601 ; for example, data in hard copy form may be appended at 
the time that the product is delivered. 

Fig. 8 shows the flow of data in the system shown in Fig. 6 in a state in which 
the image information managing company 605 and inspection organization 606 are 
integrated. 

In this case, the piping plant 601 . upon receiving an order from the customer 
607 A sends a request to an image information managing/inspection company 609 (in 
which the image information managing company 605 and inspection organization 
606 in Fig. 8 are integrated) to perform an inspection of the ordered piping product in 
an intermediate stage of manufacture, aed -as well as in the stage of the completed 
product. 

After charging a fee and receiving payment from the piping plant 601 where 
the request originated, the image information managing/inspection company 609 
r e c ei v i ng the i nspect i on r e qu e st receives image information 604 for use in inspection 
use-from the piping plant 601, performs an inspection for surface defects using the 
image processing system 608 shown in Fig. 6, and transmits the inspection results 
via the internet to the piping plant 601 where the request originated. 

The piping plant 601 that receives the inspection results also sends data 
concerning the inspection results received from the inspection organization 606 to 
the customer 607 via the internet at the time that the completed piping product is 
delivered to the customer 607. When the piping plant 601 receives notification of a 
passing inspection grade from the customer 607, the piping plant 601 submits a 
request for payment of charges, and the charges are paid by the customer. 

In the example shown in Fig. 8, as in the example shown in Fig. 7, the method 
and timing of billing and payment performed among the piping plant 601, image 
information managing/inspection company 609 and the customer are not limited to 
this example. 
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Fig. 9 shows one example of the flow of data in a case where a piping product 
that has been purchased from the piping plant 601 and us e d is periodically inspected 
during use . 

After confirming payment from the customer 607, the inspection organization 
606 that has received an inspection request from the customer 607 orders image 
information 604 for the corresponding product from the imaging information 
managing company 605. The imaging information managing company 605 that 
receives this order transmits to the inspection organization 606 image information 

604 for the corresponding product that has been stored-_and image information 604 
for the same product that is newly acquired by the digital camera 603 to th e 
i nsp e ct i on organizat i on 606 . 

Here, by referring to information relating to the imaging environment recorded 
in the image information 604 for the corresponding product that has been stored A 
when new image information 604 for the product is acquired by the digital camera 
603, it is possible to acquire image information 604 for the product at the current 
point in time in the same imaging environment as that of the image information 604 
that has been stored. 

The inspection organization 606 that has received the image data performs an 
inspection for surface defects using the image processing system 608 shown in Fig. 
6, and it_transmits the inspection results via the internet to the customer 607 that 
originated the request. The customer 607 receiving the inspection results can 
continue to use the piping product after confirming the safety of the piping product. 
Furthermore, in accordance with the demands of the customer 607, the inspection 
company 606 can also retrieve previous inspection results corresponding to the 
current inspection results from the storage means (data server), and it_can send 
these previous inspection results to the customer 607 as data that is appended to 
the current inspection results. 

In the example shown in Fig. 9, the imaging information managing company 

605 and inspection organization 606 were described as separate organizations; 
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however, it would also be possible to combine these into a single organization as in 
the case of the image information managing/inspection company 609 shown 
considered in the example illustrated in Fig. 8. In this case, the customer 607 sends 
a request for inspection to a company A (not shown in the figures) such as the image 
information managing/inspection company 609 shown in Fig. 8. Company A that 
receives this request performs an inspection for surface defects using product image 
data stored at its own location and product image data that has been newly acquired 
using the digital camera 603, this inspection being accomplished by means of the 
image processing system 608 shown in Fig. 6. Company A then transmits the 
inspection results via the internet to the customer 607 that originated the request. 

The request for inspection that is sent to the inspection organization 606 may 
also come from a third party other than the piping plant 601 or customer 607. For 
example, in a case where the customer 607 is a nuclear power generating plant, a 
request for inspection may also be made by persons having doubts regarding the 
facility^ such as the surrounding populace or the like. Furthermore, it would also be 
possible to acquire image information 604 directly from the image information 
managing company 605 without sending a request to the inspection organization 
606, and to perform independent inspection processing. The image information 
managing company 605 is operated by obtaining payment for the management of 
the image information 604 from the originator of requests for this image information 
604, e. g., the piping plant 601, the customer 607 or the like. 

By using such a system, it is possible to achieve an increase in the efficiency 
of inspections in fields where large machined products, cast products or the like are 
repeatedly inspected. 

Fig. 10 shows one embodiment of an image information search system 
constructed according to the present invention. 

Here, image information is collected and managed in an image information 
memory device 702 at a image information managing company 701 . The image 
information managing company is operated on the basis of charges for managing the 
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information and transaction sales figures. In cases where only desired image 
information is to be extracted from the image information held by the image 
information managing company 701, an image information search system 703 
provided by the image information managing company is used. The image 
information search system 703 can be called up and operated from a PC 707 that is 
connected to the image information managing company 701 via the internet 706. 
When the image information search system 703 is operated, a table of information 
items 705 is displayed. Information constituting key words is selected from these 
information items 705, and the content is input. For example, in cases where a 
confirmation of a surface inspection is to be performed for a purchased piping 
product, the location of the plant where the piping was manufactured and the 
approximate date and time are input into the image information search system 703. 

The image information search system 703 that has received a search 
command searches for image information candidates that match the input 
information in the image information memory device 702, and ILdisplays simple 
images of the candidate image information as search results 704 on the PC 707 that 
requested the search. 

As another search example, there may be cases in which a quality check of 
piping for which delivery is planned is performed. In cases where the effects of 
humidity during a certain period on the product in question are to be investigated, 
this can be accomplished by selecting the location of the manufacturing plant, the 
time of manufacture and the humidity from the information items 705 of the image 
information search system 703, and inputting arbitrary numerical values. In cases 
where the desired image information is found in the search results 704, this image 
information is purchased from the image information managing company 701. In the 
case of image information whose purchase is desired by a transaction partner, the 
image information managing company 701 sells the complete image information to 
the transaction partner via the internet 706. The party that receives the complete 
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image information can perform various types of inspections on the basis of the image 
information, either visually or by using image processing. 

Fig. 11 shows one embodiment in which the image information of the present 
invention is applied to the prevention of image falsification. 

Like Fig. 1, Fig. 11A shows in view (a) installation image information 101 for 
metal piping 109 on which a penetrating damage-locating test treatment has been 
performed, and which has been imaged by means of a digital camera for the 
purpose of making an inspection for welding defects in the welding marks 110. Fig. 
1 1B shows in view (b) watermark digital image information 1 101 for an electronic 
watermark constituting one procedure of anti-falsification means for digital images. 
Fig. 1 1B shows in view (c) image information 1 106 in which the electronic watermark 
o f F i g. 11C view (b) is embedded in Fig. 11A the installation image information 101 
of view (a) . 

An electronic watermark is something that is embedded by (for example) 
adding known data to the entire surface of an image for which the prevention of 
falsification is desired. In cases where the image is falsified following the embedding 
of the watermark, the falsification can be detected by virtue of the fact that the 
embedded information is changed when the embedded information is read out. The 
concroto w atermark processing may use the Primary Watermark technique of the 
Galaxy Group (joint proposal by IBM, NEC, SONY and Hitachi). 

The watermark digital image information 1 101 expresses the embedded 
information as image information. The embedded information of the watermark 
digital image information 1101 comprises altitude information 1102 and air pressure 
information 1 103 for the place where the installation image information 101 of view 
(a) was imaged, graphic information 1 104 which shows an approval seal that notes 
the date of the penetrating damage locating test performed on the welding marks 
110 of the installation image information 101, and shade information 1105 which 
uses a numerical value determined by the coordinates of the image in the 
background as a brightness density value. Furthermore, in the shade information 
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1 105, the positions where the numerical value data of the altitude information 1 102 
and air pressure information 1103 are embedded as several bits of embedded 
information may be determined and disposed using statistical procedures. 

Judgement of the possible falsification of the image information 1 106 in which 
an electronic watermark is embedded is accomplished as follows: namely, digital 
image information corresponding to the watermark digital image information 1 101 is 
read out from the image information 1 106 (following watermark embedding) by 
performing processing that is the opposite to that of the processing that embedded 
the watermark digital image information 1101, and the embedded information of the 
read-out digital image is compared with the known information that is embedded in 
the watermark digital image information 1 101. If these two sets of information 
disagree by even one bit, it is judged that falsification has occurred. 

In the case of the image information 1 106 in which the electronic watermark of 
view (c) is embedded, the embedded watermark information is in a visible state. 
However, it would also be possible to embed this information in an invisible state. In 
this case, the resistance of the image in processing such as rotation or enlargement 
of the image is weakened however, the information may have reversibility that allows 
reproduction of the image prior to embedding. 

Fig. 12 shows one embodiment of image acquisition means that can create 
image information to be used in the prevention of image falsification ef -in accordance 
with t he present invention. 

Here, a defect inspection device 1202 that performs a penetrating damage- 
locating test A inputs digital image data that images an inspection area that has been 
coated with a penetrating liquid and a developing agent from an imaging device 
1201 A such as a digital camera or the like. In the defect inspection device 1202, 
electronic watermark processing is performed on the image data immediately 
following image input. For example, the embedding position of 8-bit embedded 
information 1209 A such as preset characters, figures or the like,, is determined by the 
embedding position calculating part 1210 using a statistical procedure. 
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In the watermark embedding part 1203, the embedded information is 
embedded in the input image according to the data of the embedding position 
calculating part 1210. 

Since the electronic watermark used in the present device is used for the 
purpose of detecting falsification, this watermark need not have any resistance to 
processing^ such as image alteration, editing, compression or the like, and a 
watermark of the invisible and low-resistance type A in which there is no great change 
in the input image data A is desirable. As a result of the embedding of this electronic 
watermark, the presence or absence of image falsification can be detected b- by the 
defect inspection device 1202. 

Next, the image data that has been subjected to electronic watermark 
processing is inspected for the presence or absence of defects in a penetrating 
damage-locating test performed by the defect inspection part 1204. In cases where 
defects are found, inspection results A such as the location and size, area, shape, 
hue, saturation, brightness and the like of the defects A are stored in memory, and the 
defect inspection results are displayed on a display device 1208 A such as a monitor 
or the like. Afterward, the image data that has been subjected to image falsification 
preventive processing is transmitted along with the defect inspection results to other 
locations from the transmitting and receiving part 1205 via a network 1206 or the 
like. Furthermore, the transmitting and receiving part 1205 also receives image data 
sent from other locations. 

The received image data is checked for the presence or absence of 
falsification by the falsification detection part 1207. In the case of this image data, 
embedded information is read out for image data (in which the electronic watermark 
has been processed) by the falsification detection part 1207. In cases where read- 
out is impossible, or in cases where the information that is read out differs from the 
known embedded information 1211, it is judged that the image in question has been 
falsified. 
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The results of this check for the presence or absence of falsification are 
displayed on the display device 1208 (such as a monitor or the like). Furthermore, for 
received images that are free of falsification, defect inspection processing of the 
abovementioned penetrating damage-locating test is performed by the defect 
inspection part 1204. 

An electronic signature (or digital signature) using a hush function instead of 
the electronic watermark technique can also be used as a tool fef-to prevent the 
falsification of the digital image data. 

By thus using image acquisition means that can create the image information 
ef -according to the present invention as image information that prevents the 
falsification of images, it is possible to guarantee freedom from image falsification in 
digital images that are easily falsified and thus ordinarily lack reliability. Accordingly, 
such images and defect inspection results for these images can be endowed with a 
high degree of reliability, and visual inspections^ such as penetrating damage- 
locating tests and the like A can be replaced by indirect visual inspections using 
images. 

Fig. 13 shows one embodiment of an inspection report to which image 
information of the present invention is appended. 

The results of a damage-locating test inspection of the welded parts in a 
piping product 1304 are displayed in the format of an inspection report 1302 on a 
monitor screen 1301. The format of the inspection report 1302 nete- includes the 
product name, part name, manufacturing serial number, drawing number, document 
number, place of inspection, month of inspection and the name of the inspector. 
Below, the judgement results for good parts and defective parts are displayed as 
inspection results along with the inspection date for each drawing number of the 
piping product. If there are no defects in the welded state so that the part is good, 
"good" is displayed in the column for the judgement results. Furthermore, the 
presence or absence of image information imaging each piping part is displayed in 
the image presence or absence column 1310. 
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In cases where the image presence or absence column 1310 displays 
"present", this indicates that one or more sets of image information relating to the 
inspection results are linked with the inspection report 1302. When this image 
presence or absence column 1310 is clicked on by the cursor 1305, the image data 
display window 1303 displays the image information for the piping part 1304 that is 
stored in memory along with the inspection report 1302. 

Furthermore, in the detail window 1307, details of the welded state of the 
piping part 1304 are displayed in an enlarged form. The detail window 1307 shows 
an enlarged display of the region indicated in the detail display range 1306 of the 
image data display window 1303. A scroll bar 1309 is provided in the detail image 
window 1307, and arbitrary welded portions can be displayed by moving this scroll 
bar to the left or right using the cursor 1305. By observing the welded state 1308 of 
the piping product 1304 that is the object of inspection in images in which these 
welded parts are enlarged, it is possible to reproduce in these images the conditions 
under which a judgement of good or defective was made in the inspection report 
1302. 

If an inspection report to which the image information ef -accordinq to the 
present invention is appended is used, the addition of image information to an 
inspection report consisting only of character information makes it impossible to 
report false inspection results, so that the inspection report can be endowed with a 
high degree of reliability. 

The present invention can solve the following conventional probl e m po i nts 
problems : 

(1) By adding image time information and position information indicating 
the imaging location, as well as environment information such as the air 
temperature, humidity and the like at the time of imaging, to the same image, image 
information with high reliability and a high added value can be obtained, and this 
information can be utilized as information for non-destructive inspections using 
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images, monitoring of various types of manufacturing processes, and {other types of] 
process monitoring. 

(2) In image acquisition means A such as a digital camera or the like, by 
eliminating an image memory medium A such as flash memory or disk memory^ for 
preserving the captured image information and transmitting the image information to 
a data managing company immediately following imaging, it is possible to eliminate 
any possibility of falsification by the person performing the imaging or the like, so that 
the authenticity of the images is guaranteed and highly reliable image information is 
obtained. 

(3) By adding image information recording the manufacturing process, 
inspection conditions and the like to products, it is possible to back up the product 
quality, so that the products can be endowed with a high degree of reliability. 

The invention may be embodied in other specific forms without departing from 
the spirit or essential characteristics thereof. The pres e nt e mbod i ment i s foregoing 
embodiments are therefore to be considered in all respects as illustrative and not | 
restrictive, the scope of the invention being indicated by the appended claims^ rather 
than by the foregoing description^ and all changes which come within the meaning 
and range of equivalency of the claims are therefore intended to be embraced 
therein. 



